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Abstract 

Gelfand-Graev characters and their degenerate counterparts have an important role in 
the representation theory of finite groups of Lie type. Using a characteristic map to translate 
the character theory of the finite unitary groups into the language of symmetric functions, we 
study degenerate Gelfand-Graev characters of the finite unitary group from a combinatorial 
point of view. In particular, we give the values of Gelfand-Graev characters at arbitrary 
elements, recover the decomposition multiplicities of degenerate Gelfand-Graev characters 
in terms of tableau combinatorics, and conclude with some multiplicity consequences. 

1 Introduction 

Gelfand-Graev modules have played an important role in the representation theory of finite 
groups of Lie type [4, 7, 20]. In particular, if G is a finite group of Lie type, then Gelfand- 
Graev modules of G both contain cuspidal representations of G as submodules, and have a 
multiplicity free decomposition into irreducible G-modules. Thus, Gelfand-Graev modules can 
give constructions for cuspidal G-modules. This paper uses a combinatorial correspondence 
between characters and symmetric functions (as described in [21]) to examine the Gelfand-Graev 
character and its degenerate relatives for the finite unitary group. 

Let B"^ be a maximal unipotent subgroup of a finite group of Lie type G. Then the Gelfand- 
Graev character L of G is the character obtained by inducing a generic linear character from 
B"^ to G. The degenerate Gelfand-Graev characters of G are obtained by inducing arbitrary lin- 
ear characters. In the case GL(n,Fq), Zelevinsky [24] described the multiplicities of irreducible 
characters in degenerate Gelfand-Graev characters by counting multi-tableaux of specified shape 
and weight, and obtained the result that every irreducible appears with multiplicity one in some 
degenerate Gelfand-Graev character. It is known that this multiplicity one result is not true in 
a general finite group of Lie type, and in fact there are characters which do not appear in any 
degenerate Gelfand-Graev character in general. This follows, for example, by work of Kotlar 
[11] which gives a geometric description of the irreducible characters appear in some degenerate 
Gelfand-Graev character in general type. In the finite unitary case, we give a combinatorial de- 
scription of which irreducible characters appear in some degenerate Gelfand-Graev character, as 
well as a combinatorial description of a large family of characters which appear with multiplicity 
one. 

Section 2 reviews the necessary combinatorics and results from [21]. Section 3 examines the 
Gelfand-Graev character, and uses a remarkable formula for the character values of the Gelfand- 
Graev character of GL(n,Fq) (for an elementary proof see [9]) to obtain the corresponding 
formula for U(n,Fg2). The following is the main result of this section. 
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I. (Corollary 3.1) If F^^) is the Gelfand-Graev character of U(n,F^2), and g G U(n,Fq2), then 

-l)K2J+(^)(g^ _ (_i)^) ... (g - 1) if 5 is unipotent, block type (/xi,//2, . . . 
, otherwise. 

Section 4 computes the decomposition of degenerate Gelfand-Graev characters in a fashion 
analogous to [24], with the main result as follows. 

II. (Theorem 4.3) The degenerate Gelfand-Graev character ^[k,v) decomposes as 

A 

where A is a multi-partition and mx is a nonnegative integer obtained by counting "battery 
tableaux" of a given weight and shape. 

In the process of proving Theorem 4.3, we obtain some combinatorial Pieri-type formulas 
(Lemma 4.2) and decompositions of induced characters from GL(n,F^2) to U(2n, Fg2) (The- 
orem 4.1 and Theorem 4.2). 

Section 5 concludes with a discussion of the multiplicity implications of Section 4. In par- 
ticular, we improve a multiplicity one result by Ohmori [17]. 

III. (Theorem 5.2) We give combinatorial conditions on multipartitions A that guarantee that 
the irreducible character appears with multiplicity one in some degenerate Gelfand-Graev 
character. 

Another question one might ask is how the generalized Gelfand-Graev representations of the 
finite unitary group decompose. Generalized Gelfand-Graev representations, which were defined 
by Kawanaka in [10], are obtained by inducing certain irreducible representations (not necessarily 
one dimensional) from a unipotent subgroup. Rainbolt studies the generalized Gelfand-Graev 

representations of U(3,Fy2) in [18], but in the general case they seem to be significantly more 
complicated than the degenerate Gelfand-Graev representations. 

Acknowledgements. We would like to thank G. Malic for suggesting the questions that led 
to the results in Section 5, S. Assaf for a helpful discussion regarding Section 5.1, and T. Lam 
helping us connect Lemma 4.2 to the literature. 



2 Preliminaries 

2.1 Partitions 

Let 

V = Vn, where Vn = {partitions of n}. 

n>0 

For v = . . . € Vn, the length l{u) of u is the number of parts I, and the size \v\ of u 

is the sum of the parts n. Let v' denote the conjugate of the partition v. We also write 

y = (imiH2'"2M . . . ), where mi{v) = \{j G Z>i | = 
Define n(z^) to be 

™(^) = ~ 

i 

If /X, 1/ G V, we define iJ,Llv e V tohe the partition of size -|- \u\ whose set of parts is the union 
of the parts of /x and u. For k G Z>i, let kv = (kvi, ki'2, . . .), and if every part of u is divisible 
by k, then we let v/k = {fi/k, i'2/k-, ■ ■ ■)■ A partition u is even if ui is even for 1 < i < £(z^). 
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2.2 The ring of symmetric functions 

Let X = {Xi,X2, . . .} be an infinite set of variables and let 

A{X)=C\pi{X),p2{X),...], where pfc(X) = + X| + • • • , 

be the graded C-algebra of symmetric functions in the variables {Xi , X2, ■ ■ ■}■ For ly = (1^1 , 1^2, . . . , i'^) G 
V, the power-sum symmetric function Pv{X) is 

p,iX)=p,,iX)p,,iX)---p,^iX). 

The irreducible characters of Sn are indexed hy X eVn- Let a;^(z/) be the value of on 
a permutation with cycle type v. 

The Schur function s\{X) is given by 

sx{X) = u;\ij)z-'p,{X), where = \{i'^^mi\ (2.1) 

is the order of the centralizer in 5^ of the conjugacy class corresponding to = (l'"i2"*2 . . . ) g 7?. 
Fix f G C^. For fi eV, the Hall-Littlewood symmetric function Pn{X;t) is given by 

sa(X)= J] K^^{t)P^{X;t), (2.2) 

where K\^{t) is the Kostka-Foulkes polynomial (as in [16, IIL6]). For z^, /x G Vn, the classical 
Green function Qv (t) is given by 

p,{x)= J2 Qt{t-^T^^^PM-S- (2-3) 

As a graded ring, 

A(X) = C-span{p^(X) \ u (^V} 
= C-span{sA(X) I A G P} 
= C-span{P^(X;t) | /x G T'}, 

with change of bases given in (2.1), (2.2), and (2.3). 

We will also use several products formulas in the ring of symmetric functions. The usual 
product on Schur functions 

sus^, = cl^sx (2.4) 
gives us the Littlewood-Richardson coefficients c^^. The plethysm oi Pu with p^ is 

PuOPk =Pkv 

Thus, wc can consider the nonnegative integers c]^ given by 

s\op^= ^ ^ ^^\ kv = clsy. (2.5) 
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Chen, Garsia, and Remmel [2] give a combinatorial algorithm for computing the coefficients c]|. 
We will use the case A; = 2 in Section 4.4. 

Remark. The unipotent characters of GL(n, Fg2) are indexed by partitions A of n and the 
unipotent characters of U(2n,F^2) are indexed by partitions 7 of 2n. It will follow from 
Theorem 4.2 that 



|7|=2|A| 

where i?^ is Harish-Chandra induction. 
2.3 The finite unitary groups 

Let Gn = GL(n,Fq) be the general linear group with entries in the algebraic closure of the finite 
field ¥q with q elements. 

For the Probenius automorphisms F, F, F' : Gn ^ Gn given by 

i^(K-)) = (4)' 

F{{a^,)) = {a%)-\ (2.6) 
= («n-,•n-^)~^ ^here {aij) G Gn, 



let 



Gn = G^ = {aeGn I F{a) = a}, 

Un = G^ = {aeGn I F{a) = a}, (2.7) 
K = G^ = {aeGn I F'{a) = a}. 

Then G„ = GL(n, F^) and U'n = Un are isomorphic to the finite unitary group U(n,Fq2). In 
fact, if follows from the Lang-Steinberg theorem that U'n and C/„ are conjugate subgroups of G„. 
For k e Z>o, let 



T^k) = Gf =F". and T^^) = Gf ^ 



For every partition rj = (ryi, 772, ■ ■ ■ , %) ^Vn let 



F^j. if A; is even, 

{te¥q I = 1} if A; is odd. 



Every maximal torus of Gn is isomorphic to Tn for some r] G and every maximal torus of 
Un is isomorphic to for some r] EPn- 

2.4 Multipeirtitions 

Let F : Gn ~> Gn he as in (2.6), and let f* = {(p : ^ C^} be the group of multiplicative 
complex- valued characters of F^ . Consider 

$ = {F-orbits of F^ } and = {F-orbits of F*}. 
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For X e {$, e}, an X-partition X = (A(^i\ A^^^)^ ) 

is a sequence of partitions indexed by 

X. The size of A is 

|A| = ^|a;||A(-)|, 

where |x| is the size of the orbit x. 
Let 

-p-^ = [jVn, where = {Af-partitions of size n}. 

n>0 

For XeV^, let 

i{X) = J2 ^('^^''^) and n(A) = J2 \xHX^''^). 

The conjugate of X € is the ;i:'-partition A' defined by A'^^^ = (A^^^)', and if ^it, A G P-^ , then 
^ U A € P-^ is defined by (fi U A)(^) = ^(^) U A^^). 

The semisimple part Xs of an Af-partition A is the -Y-partition given by 

Xif) = fovxeX. (2.8) 

For XeV"^, define the set by 

= {/X e 7?-^ I /I, = A,}. 
The unipotent part Xu of A is the ^-partition given by 

A(/^>' has parts {|x|Af^ | x X,i = 1, . . . ,e{X{x))}, (2.9) 

where {1} is the orbit containing 1 in $ or the trivial character in Q, and aI^'' = when x ^ {1}. 

Note that we can think of "normal" partitions as A:'-partitions A that satisfy Xu = X. By a 
slight abuse of notation, we will sometimes interchange the mulipartition A„ and the partition 
Au^^^^. For example, T^,, will denote the torus corresponding to the partition X^^^\ 

Given the torus T^, r] = (r/i, 772, . . . , %) &Vn, there is a natural surjection 

T0: {9 = 91^020 ■■■^OeeBom{Tr^,C'')} {i^ G | 4™ = ??} ^ 10) 

9 = 9i®92®---<^9i ^ T0{9), ^ ' ' 

where 

T0(6')('^) = {vh/\^\,Vi2/\'P\^ ■ ■ ■^Vir/\V>\), where 9ij^,9i2, ...,Bi^(^ip. 

It follows from a short calculation that if 1/ G has support {ip\,(p2, . . . ,ipr}-, then the preimage 
t'^{v) has size 



({!}))), 



^eG i>i\.\.>pe0K^t/\'p\K'^^'^'))- 

The conjugacy classes Ri^ of Un are parameterized by /x G V^, a fact on which we elaborate 
in Section 2.5. We have another natural surjection, 

T$: Tr, ^ {i^GP* I i/l™=7?} .2 12) 

t = {ti,t2,...,te) ^ r$(ii)Ur$(t2)U---UT$(t^), 

where 

T^{ti) = n', a ti e in Urj,. 
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2.5 The chciracteristic map 

For every / G let X'^^^ = {x[-^^ , Xg'^-' , . . .} be an infinite set of variables, and for every E @, 
let F^"^) = {Y^'^\Y2'^\ . . .} be an infinite set of characters. We relate symmetric functions in 
the variables X^^^ to those in the variables Y^'^^ through the transform 

= (-l)'''^!-' Yl e(^)PfcM/|/.|(^^^^^), where e e V', X G 
The ring of symmetric functions A is 

A = (g)A(x(/)) = (g)A(y('^)). 

fee 

For fj, G V^, the Hall-Littlewood polynomial is 

and for A € "P®, the power-sum symmetric function px and the Schur function sx are 
For iJ,,u E V^, the Green function is 

where = {/ G $ | ^t*^-^-* 7^ 0}. As a graded rings, 

A = C-span{p^ | v eV^} 
= C-span{sA I XeP^} 
= C-span{P^ I neV^}. 

The conjugacy classes of Un are indexed by /i G and the irreducible characters 
of are indexed by A G [5, 6]. Thus, the ring of class functions C„ of Un is given by 

C„ = C-span{x^ | A G P®} 
= C-span{«;'^ | /j, G P®}, 



where : C/„ ^ C is given by 



1 ifgeRi^ 
otherwise. 



We let x'^Ia*) denote the value of the character x^ on any element in the conjugacy Ri^. 
For 1/ G 7^®, let the Deligne-Lusztig character = R^" be given by 

R^ = R^- (0) 
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where 9 G Hom(Tj^^, C^) is any homomorphism such that tq(0) = u (see (2.10)). 
Let C = 0„>i Cn so that 

C = C-span{x^ | A G P®} 
= C-span{K^ I fieV^} 
= C-span{i?^ I ueV^} 



is a ring with multiphcation given by 

The next theorem follows from the results of [4, 6, 8, 10, 15, 21]. A summary of the relevant 
results in these papers and how they imply the following theorem is given in [21]. 

Theorem 2.1 (Characteristic Map). The map 

ch: C ^ A 

■^A ^ (_l)L|A|/2j+n(A)^^ 
I— > P 

^ (-l)l-lV)p^ 
is an isometric ring isomorphism with respect to the natural inner products 

{X^, X^) = ^Xr, and {sx, Srj) = Sxr,- 

In the following change of basis equations, (2.13) follows from Theorem 2.1, (2.14) follows 
from (2.1), and (2.15) follows from [21, Theorem 4.2]. 

(_l)LA=/2j+n(A)^^^ X^M)^'m for AGP,®, (2.13) 



Eln^^^^K 'o.XeVS, (2.14) 



Xs=Va 



(-l)'-'^'^W = E ( E io.,.€V^,Te{9) = i^. (2.15) 



3 Gelfand-Graev characters on arbitrary elements 

3.1 Gn = GL{n, ¥g) notation 
In this Section 3, let 

4> = {F-orbits in fg} and G = {F-orbits in F *}. 

The same set-up of sections 2.4 and 2.5 gives a characteristic map for Gn = GL(n,Fg) by 
replacing $ by 6 by G, -q by q, Tq,-) by f^k), and (-l)L"/2J+"(A)s^ by with the 
exception of the Deligne-Lusztig characters (which follows from the parallel argument of [21, 
Theorem 4.2]), this can be found in [16, Chapter IV]. 
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3.2 The Gelfand-Graev cheiracter 

We will use = GL{n,¥g)^' (see (2.7)) to give an explicit description of the Gelfand-Graev 

character. For a more general description see [4], for example. 

For 1 < i < j < n and t € F^, let Xij{t) denote the matrix with ones on the diagonal, t in 
the ith row and jth column, and zeroes elsewhere. Let 

Uij{t) = Xij{t)xn+i-j,n+i-ii-t'^) for 1 < i < j < [n/2\, t £ F^2, 

Ui,n+l-j{t) = Xi^n+l-j{t)xj^n+l-i{-t'') for 1 < i < j < Ln/2j , te¥q2, 

and for 1 < A; < [n/2j , and t,a,b E Fg2, let 

fJ'kiO') = 2;fc,n+i-fe(fl) for IT' even, and + a = 0, 

Uk{a, b) = x^n/2],n+i-k{-a'')xk,n+i-k{b)xk,in/2] («) for ri odd, and a^+^ + 6 + 6^ = 0. 

Examples. In U!^, we have 

Voooi/ Voooi/ Voooi/ 

where + a = 0. In [/g, we have 

(ItOOOX /lOOtOX 
1 \ , , / 1 -tM 

1 , ^^(i) = 1 , 
1 -t'? i ' I 1 r 

00001/ XOOOOl/ 

(10a06\ /lOOOOX 

01000\ /01a60\ 

1 -a« , tt2(a, 6) = 1 -a9 , 

00010/ \00010/ 

00001/ XOOOOl/ 

where a«+^ + 6 + 6^ = 0. 

For 1 < i < i < [n/2j, and 1 < A; < [n/2j, define the one-parameter subgroups 



Xi,n+l-j = {Ui,n+l-j{t) I t e¥g2} = ¥%, 



Xk 



{uk{t) I t € ¥g2,t'^ + (Z = 0} if n is even, 

{■^^(0,6) I a,b e¥ 2,ai+^ + b + bi = 0} if n is odd. 



so that 



B< = {Xij,Xi,n-j,Xk I l<i<j< Ln/2J, 1 < A; < Ln/2J) C [/^ 
is the subgroup of of upper-triangular matrices with ones on the diagonal. Noting that 

^k/[^k,^k] — ^q, 

a direct calculation gives 

K/K, K] = ^12 X X23 X . . . X XL„/2j-l,Ln/2j X ^[n/2l = (FJ)L"/2J-1 X ¥+ . 

Similarly, let 
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be the subgroup of unipotent upper-triangular matrices in G„. 

Fix a homomorphism ip : ¥'^2 ^ of the additive group of the field such that for all 
1 < k < ln/2\, tp is nontrivial on Xk/[X.k,Xk]- Define the homomorphism : — > C by 



_ J ii a = + 1 <i < [n/2\ , or if a = [n/2j , 
1 otherwise. 



3Ca 

The Gelfand-Graev character of is 

Tn = Ind^<(V'(n))• 
Recall that U!^ is conjugate to Un in G„. If U!^ = yUny~^, then let 

Similarly, the Gelfand-Graev character of G„ is 

f(„)=Indg^^(V;(n))- 

where : — > C is given by 

It is well-known that the Gelfand-Graev character has a multiplicity free decomposition into 
irreducible characters [20, 22, 23]. The following explicit decompositions essentially follow from 
[3]. Specific proofs are given in [24] in the G„ case and in [17] in the C/„ case. 



Theorem 3.1. Let ht(A) = max {^(A^'^))}. Then 



ht(A) = l ht(A) = l 



3.3 The chciracter values of the Gelfand-Graev chciracter 

A unipotent conjugacy class Ri^ of Un or G„ is a conjugacy class that satisfies 

fJ'u = fJ'- 

The unipotent conjugacy classes of and G„ are thus parameterized by partitions /U of n. 
Lemma 3.1. 
(a) Let IX e P®, Ati'^^^^ = ^l. Then 

r(n)(M) = I ^'^ePn (-1)"+^"^'^ '^'' lr^lQi^(-g) if IX is unipotent, 
1 otherwise. 

(h) Let IX e r^, Ati^^^^ = n. Then 

f(n)(At) = I ^'^eT'n (-^)^^'^'' |j;|g(;(g,) i/^ is unipotent, 
1 otherwise. 
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Proof. Note that if ht(A) < 1, then n(A) = 0. Thus, by applying the characteristic map and 
(2.14) to Theorem 3.1, 



,.^G ...^e / 



ht(A)<l i/3=As 



Since ht(A) < 1, lo^^"^^ is the trivial character for all G 6. Thus, the summand is independent 
of A, and 

ch(rH) = (-i)L"/^j E(n-:(l))^^^- 

By (2.11), 

ch(r(,)) = 



i^eT'eV.^ee j>i ll¥'eGl"Vkl '^'^ esHom(T^„,cx) Ve 



XQ(e)=iy 



(-i)K^j 5: 5: z-s 



i^eP„6»eHom(T^,Cx) 

The change of basis (2.15) gives 

ch(r(„)) = (-i)K^j 5: y: ^^^e e 

T^(t)s=Ms 

= (-l)L"/^J E E^^^ E E eit)Q-^^^^i-,)P,. 

H&V^v&Vn " 6>eHom(T^,Cx) 

By the orthogonality of characters of T^, the inner-most sum is equal to zero for all i 7^ 1. If 
t = 1, then T$(l, 1, . . . , 1)(^) = for / / {1} and t$(1, 1, . . . , 1)(^^» = z/. Thus, 



ch(r(„)) = (-l)L"/2J ^ ^ LiZ:i^|T,|Q^(-g)P^, 

MSP* J^ePn 

and in particular, if ^i^^^^ = /x, 

Z^i^eVn \Tu\Qi:{-q) if H is unipotent, 

otherwise. 

(b) The proof is similar to (a), just using the G„ characteristic map. □ 

The values of the Gelfand-Graev character of the finite general linear group are well-known. 
An elementary proof of the following Theorem is given in [9]. 
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Theorem 3.2. Let neV^ with fx = n^^^^K Then 

f (/i) = I (-1)""^^"^ U1=Kq' - l) «/M is unipotent, 
1 otherwise. 

We may now apply Theorem 3.2 and Lemma 3.1 to give the values of the Gelfand-Graev 
character of C/„. 

Corollary 3.1. Let fieV^ with /x = ^ti^^^^ Then 

Y (^) = I (-1)^"/^^"^^''^ nS((-^)' - 1) unipotent, 
^"'^ 1 otherwise. 

Proof. Combine Lemma 3.1 (b) with Theorem 3.2 to get 

(_i)^(.)jj(,^_i)=^L2^|r.|QM(,), 

i=l veVn 

which implies 

Make the substitution g i— > — g to get 

n (1 - (-g)O = E - 11(1 - (-g)-OQ/;(-g), 

i=l t'G'Pn i=l 

which implies 

(_l)Ln/2j+.(.) -Q^^,^). - 1) = E \T.m-^)- 

i=l UGVn 

Apply this last identity to Lemma 3.1 (a) to obtain the desired result. □ 

4 Degenerate Gelfand-Graev characters 

4.1 Gn — GL{n,¥q2) notation (different from Section 3) 

In this Section 4, let G„ = GL(n,Fq2), 

$ = {F2_Qj.^j^g of }, and 6 = {F^-orbits of F*}. 

Note that now = Un and = U^^. The same set-up of sections 2.4 and 2.5 gives a charac- 
teristic map for G„ by replacing $ by 4>, 9 by 9, —q by q, T^j^) by T(^2k)j and (— 1)L"/2J+«(A)^^ 
by sx- 
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4.2 Degenerate Gelfand-Graev cheiracters 



Let {k, v) be a pair such that v h G Z>o, and let 

J^< = {v<i,v<2,---,i^<i)^ where v<j = vi + V2^ hVj. 

Then the map V'(fe,i/) ■ -B^ ^ C^, given by 



' ip if a = (i, i + 1), 1 < i < [n/2\, and i ^ i/<, 
= < if a = [n/2j and [n/2j ^ z/<, 
•^a/[Xa,Xal ^ 1 otherwisc, 



is a linear character of i7^. Note that '0([n/2]-[n/2j,(iL"/2j )) is the trivial character and 'ip(^n,il)) = 
i/j^n) of Section 3. 

The degenerate Gelfand-Graev character ^[k,^) is 

r^k,u) = Ind^i = Ind^^<^_i(yV'(fc,.)y-'), 

where y is an element of G„ such that yU'^y~^ = f/„. In particular, the Gelfand-Graev character 



is r(n,0). 

Let 
where 



L[k,.) = {Lu,L^^\L^^\---^L^^), 



Then 



L^r^ = (Xi^. I j.<^_i < i < J < u<r) = GL(z/^,F„2). 



L'(j^ . ^ U(fc,F^2) © GL(z/i,F^2) © • • • © GL(z/^,F^2] 



is a maximally split Levi subgroup of C/^. For example, if n = 9, A; = 3, and u = (2, 1), then 



r' _ 



f / A \ 

5 

C 

F'{B) 

^ V F'{C) J 



^ G GL(2,Fg2),5 G GL(l,Fg2),C G f/(3,F^2] 



> . 



Note that since L^' C 1/2^. = C/2i/j, the Levi subgroup 

U(k,u) =Uk® U2u, © C/21.2 ® ■ ■ ■ ^ 



U2ue C C/n 



contains a Levi subgroup L = Uk (B Li 



Lf with L,- C J/oiy.- such that L = L 



Proposition 4.1. Let {k, v) he such that u h G Z>o. T/ten 



ch(r(,,.)) = ch(r(,))ch(i?g7;(f(.^)))ch(i2g^^^^^ 



where ^{rn) is the Gelfand-Graev character of Gm = GL(m,Fq 
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This proposition is a consequence of Theorem 2.1 and the following lemma. 
Lemma 4.1. Let (k, v) he such that v h G Z>o. Then 



®f (,,)), 



Proof. Since ^-^ is maximally split, 

^^^%y-Ayi^ik,u)y-') = ind^i(^(fe,.)) = indf^f (r(,) ® f(, 

where Indf^^ is Harish- Chandra induction. However, 

indfg (r(fc)(8)f(,^)®---®f(,^)) = i?g (r(fe)®f(. 

By transitivity of Deligne-Lusztig induction, we now have 

4.3 Symplectic tableaux and domino tableaux combinatorics 

Augment the nonnegative integers by symbols {i \ i E Z>o}, so that we have 

{0,1,1,2,2,3,3,...}, 



□ 



and order this setbyi — l<i<i<i + l. Alternatively, one could identify this augmented set 
with ^Z>o hy i = i — ^. 

Let A = (Ai, A2, . . . , Xr) be a partition of n and (mo, mi,m2, ■ ■ ■ , m^) be a sequence of non- 
negative integers that sum to n with rriQ < Ai. A symplectic tableau Q of shape A/(mo) and 
weight (mo, mi, . . . , m^) is a column strict filling of the boxes of A by symbols 



such that 



m,; 



{0,1,1,2,2,...,^,^}, 

number of O's in Q if i = 0, 

number of i's + number of i's in Q if i > 0. 



We write sh{Q) = A/(mo) and wt{Q) = {mo, mi, . . . ,m^). For example, if 

Q 









1 


1 |4| 


1 


2 


2 




3 
_3 









then sh(Q) 



and wt(Q) = (2,3,2,2, 1) 



Let 



{mo,mi,...,m() 



(4.1) 



symplectic tableaux of shape A/ (mo) 
and weight (mo, mi, . . . , m^) 

A tiling of A by dominoes is a partition of the boxes of A into pairs of adjacent boxes. For 
example, if 

I I I I I I , 
A = U , then 
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is a tiling of A by dominoes. 

Let (mo, mi, . . . , m^) be a sequence of nonncgative integers such that niQ < Ai and |A| = mQ + 
2{mi + • • • + m(). A domino tableau Q of shape A/ (mo) = sh{Q) and weight (mo, mi, . . . , m^) = 
wt{Q) is a column strict filling of a tiling of the shape A/(mo) by dominoes, where we put O's 
in the non-tiled boxes of A, and where mj is the number of z's which appear. For example, if 



Q 



o|o 


3 


3 1 


1 









then sh(Q) 



and wt(Q) = (2, 1,1,2). 



Let 



A 

{mo,mi,...,m() 



domino tableaux of shape A/ (mo) 
and weight (mo, mi , . . . , m^) 



(4.2) 



In the following Lemma, (a) is a straightforward use of the usual Fieri rule, and (b) is both 
similar to (and perhaps a special case of) [14, Theorem 6.3], and also related to a Fieri formula 
in [12]. 

Lemma 4.2. Let {mo, mi, . . . ,m^) be an £ + 1-tuple of nonnegative integers which sum to n. 
Then 

t rUr 

(a) Hmo)Il^Hi)H^r-i)= Yl l^(mo,mi,...,m,)l*A, 
r=l 1=0 XeVn 



r=l 1=0 

Proof, (a) Note that 



•mr-i) — X] ^ l)"'^'*'^l^fmo,mi,...,m^)l*A- 



i nir £ 
^(.rno) n Yl ^{i)^{nir-i) = Yl *Ko) 11 *(v)«(m.-v)- 

r=l i=0 0<ir<mr r=l 

l<r<i 



Now repeated applications of Fieri's rule implies the result, 
(b) Note that 



r=l 1=0 



r=l 



l<r<e 



By Fieri's rule, 



Number of column strict fillings of A 



Y *("^o) n ^(v)«(2m.-v) = Y -mo O's, and for r = 1, 2, . . . , ^, sx- 



l<r<e 



r=l 



Ae'P2n-mo \ using V ^'s and {2mr — ir) ^'s. 



By observing that the sign counts the number of barred entries, 



r=l i=0 



Number of barred entries in Q 



^ ^ (ttiq ,2m]^ ,.. ., 



sx. (4.3) 
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We therefore need to determine the cancellations for a given shape A. 

Fix r e {l,2,...,i} and X e V such that "T^^^ 2mi 2mi) ^ ^- ^ tableau Q G 

(mo,2mi,...,2m^)' 

= skew tableaux consisting of the boxes in Q containing f or r, 
<Sq ■* = {column strict fillings of sh.{Qr) by elements in {f, r}}. 

For example, if 



Q 









1 


1 1 1 1 


1 


2 


2 




3 








3 













l|l|l| 


I 















1 1 1 1 1 1 






1 1 1 1 1 


I 






I 















(1) 



(In fact, \S!^^\ = 8). 

In light of (4.3), (b) is equivalent to 



E/_-^^Number of f's in Q' ^ f (-l)''^'''^'^'-)) if sh{Qr) has a domino tiling, 
1 otherwise. 

(r) 

Note that in row j, Q & Sq is of the form 



d-i 




. . 




r 




r 


7 1 ■•• 1 ? 1 < row j — 1 


r 




r 


? 1 ••• 1 ? 


r 




r 


< row j 


? 1 ■•• 1 ? 


r 




r 




< row j + I 



Thus, we have dj + 1 choices for the values in row j. If the total number of choices is even, then 
exactly half of these choices give a positive sign and half give a negative sign. So we have 



^ ^ ^ j^^Number of r's in Q' q 



'£5, 



(r) 



unless dj is even for all rows j (that is, sh(Q,.) has a tiling by dominoes). In this case, the signs 
of all but one of the possible tableaux will cancel each other out, so the only tableau that we 
have to count has row j of the form 



dj+i 
. " , 


dj 


r 




r 




r 




r 


r\ ■■■ \r 


r 




r 




r\ ■■■ \r 


r 




r 







row j — 1 

row j 
row j + 1 



which can clearly be tiled by dominoes of the form and [Z]- For this tableau, we have 

Number of f's _ ^_-j^^n{sh{Qr)) 

Thus, 



mo, mi,..., me 



as desired. 



□ 
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Let A G and 7 e be such that ht(7) < 1 and |7('^)| < X^^^ for all <peG. A battery 
Q-tableau Q of shape A/7 is a sequence of tableaux indexed by 9 such that 



Q 



if) 



a domino tableau of shape X^'^^ / 'y^'^'> if \ip\ is odd, 
a symplectic tableau of shape X^'^^'j^'^') if \(f\ is even. 



The weight of Q is wt(Q) = (wt(Q)i, wt(Q)2, . . where 



<pe@ 

\ip\ odd 



\ip\ even 



Let 

fij.^^^ = {Q battery tableaux | sh(Q) = A/7, 7 G , ht(7) < 1, wt(Q) = z/}. (4.4) 
Example. If 



then ^5 contains 







(^i) 



1 2 



2 ^^(^1) ^(^2) 



2 /^0[O](^1) [11^(^2) 



'3) 







(^1) |Y[T| (^2) 



](^3)\ / 







(^1) 



11 







'■^'^ |T|T| ('^") LI 2 



Some intuition. If A G P®, we can think of the boxes in A^*^-* as being \ip\ deep, so in the 
above example. 













> 









ifl) 









{ ■ 















A battery 6-tableau is a way of stuffing the slots by numbered "batteries" where front and back 
are distinguished by i and i, but the sides look generically like i, so 



Then a battery 6-tableau might look like: 



/ 


/ 


/ 








■' 


1 


/ 





2 


1 





SO the weight of the tableau counts the number of batteries of a given type get used, regardless 
of the cardinality of 
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4.4 Inducing from G„ to C/; 



2n 



Note that any maximal torus T,y of G„ C U2n becomes the maximal torus of U2n, which 
gives rise to the map 



I ■ < 



' Pairs {f^,e^) with a ^ ( Pairs {T2u,0,y) with T2u a 

max;imal torus of G„, > — > < maximal torus of U2n, 
GHom(f^,C><) J i G Hom(T2^,C> 



To translate the combinatorics between G„ and U2n, we define the map 

A ^ .A wherefore GO, .A - [ ^ -^m^)) ^ ^ ^ ^ 

which has the property that tq o i = o Tq (see (2.10)). The map l is neither surjective nor 
injective. We note that F(p = (fi implies that \ip\ is odd, and if F(f) ^ (p, then = (pUF(p implies 
\(p\ is even (see [5]). Thus, the image of l is the set of even 0-partitions, 

lmage(0 = {A G | \(p\X'^'^^ is even for ip € G}. 

Theorem 4.1. 



^G:(f(n))= E \B^O,in))\r 



ht(A)<2 



Proof. Note that by Theorem 3.1, (2.14), and the characteristic map for G„, 

/ 1 \n-i(i>) 

ASP® ASP® £>e-p^ 

ht(A)=l ht(A)=l 



By transitivity of induction, and the fact that tq o i = t o Tq, we have -Rg^" i^p" ) = > and 



so 



/ 1 \n-^(i>) 



ht(A)=l 



We now change the second sum to a sum over u = ii> e , and we obtain 



ht(A)=l 'i^^f 
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Recall that Fip = (p implies that \(p\ is odd, and F(p ^ (p impHes that = U F(p where \ip\ is 
even. Apply the characteristic map, factor, and then reindex to obtain 



f even lO — v 



=(-1)" E n -Vf^-'>(^"") n ( E iV)^"'"*^""' 

cvcS \'-p\ °dd Ivl even 

E n( E i^f^(^""))n( E iV""*^""*)- 

' 2n 1,-1 I I I fin^i /.-x. 



'Y even 



Jt(,^)?ri l"^! °dd kNlT^"^)! Ivl even + = 

.."■i.^ 1/ even 

Note that by (2.1), 



A computation similar to [16, 1.2.14] shows that 

1 



h> even 



Thus, 



ch(iig-(f(„))) = (-ir n (4.5) 



ht{T) = l 
-y even 



Lemma 4.2 (a) and (b), respectively, imply that 

k 

Es(i)S(fe-i) = Y l^(o,fc)l*A, and 

k 

i=0 \ePk 

Since ^^2)1 = l'^(ofc)l = ^ unless ht(A) < 2, 

ch(i2£"(f(„))) 

"7 even 

• n E K.Mi)i^A(.)(^^^^) 

I^Ttven |A(^)| = |t(^)| 



ht(A)<2 

Apply ch~^ to get the result. □ 
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Corollary 4.1. For n G Z>i, 



ch(i?g-(f(„))) = (-1)" n E(-i)"^'^w(^^''^)«(i-(-)i-)(^^''^)- 



ht(i^)=l 
1/ euen 



Proof. This is (4.5) in the proof of Theorem 4.1. □ 

Using similar technigues, we can prove a result for arbitrary irreducible characters of G„. 
For A G and 7 G Vj^, let 



= n "^i^"*^)' ^^^"^^ <^i('^) 



Ca(0) if = g e, 



'^ee I c?'J' if <^ = U and 7^ G e, 

where c^^ is as in (2.4), and is as in (2.5). 
Theorem 4.2. Let A G P®. T/ien 

Proof. By (2.14) and the characteristic map for G„, 



By transitivity of induction, and the fact that re o z = i o Tq, we have R]qJ^{R2") ~ ^^"^ 
so 



^oTix') = E ( n ^4^)(-i)"-^(^)i?.^-. 



We now change the sum to a sum over u = lu E Vs^, and using the image of the map l, we 
obtain 



.ePl^SeP.^ >e® ^ 

1/ even ti>=u 

Apply the characteristic map, and rewrite the inner sum and product, to get 

ch(«gr(x^)) = (-1)" E ( i:_ ( n ^^^^^))''- 



f even 



^ (i/('^)/2) T-r / t^"^ (7)0^"^ (m) 



(-)" E n n E 

f even PV=V FV^V - (p^) 
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Recall that Fip = (p implies that \ip\ is odd, and F(p ^ (p implies that ip = (pU F(p where \(p\ is 
even. Thus, for every (p Q such that i^*^*^^ 7^ 0, if \(p\ is odd then ^ = 'p for some (p & Q, and if 
\(p\ is even then ip = <pL) Ftp for some (p & Q. Factor our expression accordingly as 



"even l^l^lXC-F"^) | 

|mI = |a(^*')| 

The first product is the case that \(p\ is odd, and the second product is the case that \ip\ is even. 
For the sum in the first product, note that 

E ( E ^^>- ( E ^^.) ( E 

W\=\M+H ^ hi=i^| ^ ^ \\=\M ^ ^ \\=H ^ 

= SxSr,. 

For the sum in the product for \ip\ even, we have 

E ^^2-= E -^P-°P{2) 

1H = 1A| IH = |A| '^'^ 

where o is the plethysm product (2.5). Thus, from the definition of the coefficients c^, we have 



ch(i?g-(x^)) = (-1)" ^--^ 



1 



as desired. □ 

It is perhaps worth noting that since we know the Harish-Chandra induction b!q" (x^) gives 
a character, then the sign of the coefficient must be (—1)"'^'''). 

4.5 Degenerate Gelfand-Graev chciracters 

The following theorem is our main theorem of Section 4. 

Theorem 4.3. Let n E Z>i and let {k, v) satisfy v h G Z>o. Then 

^(M = E \^^k,v)\x^- 
Proof. Recall that by Proposition 4.1, 
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By Theorem 3.1 and Corollary 4.1, 



ch(r(,)) = (-l)L^/2J ^ J]s^(,,(yM), and 



ht(7)=l 



ht(T) = l 
•7 even 

Thus, 

ht(70)=l '''■^^^flr 

ht{-rr) = l 
'y^ even 

Fix G B, and let = iTr"^^!- If If] is even, then Lemma 4.2 (a) implies 

'■=1 i=0 \\\=mo+---+m^„j 

If is odd, then Lemma 4.2 (b) implies 

iif) m.r 

^{-o)nE(-l)'^W^(— ^) = E (-l)"^'^I^C;no,m,A...,n.,(.)/2)kA. 

Therefore, 



ht(7r)=l 
-Yy. even 



even 



" .>^e odd eve 



ht(T^) = l 
■7^ even 

The result follows by applying ch~^. □ 

5 Some multiplicity consequences 

In this section we explore some of the multiplicity implications of Theorem 4.3. 
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5.1 A bijection between domino tableaux and pairs of column strict tableaux 



The 2-core of a partition A G "P, which we denote core2(A), is the partition of minimal size such 
that the skew partition A/core2(A) may be tiled by dominoes. It is not difficult to sec that the 
2-core of any partition is always of the form (m, m — 1, . . . , 2, 1) for some nonnegative integer m 
(where (0) is the empty partition). 

The 2-quotient of a partition A, quot2(A), is a pair of partitions (quot2(A)(°),quot2(A)(^)) 
(defined in [16, I.l, Example 8]). We define 



quot2(A)i = quot2(A)f ^ + quot2(A)j^ 

Also define the content of a box □ in the ith row and jth. column of a partition A to be j — i. 
Let X £ Vn with core2(A) € {(0), (!)}• Consider the bijection 



(|core2(A)|,mi,...,m£) 



Q 



Pairs of column strict 
tableaux of shape quot2(A) 
and weight (mi, m2, . . . ,mg) 



(5.1) 



given by the following algorithm, which originally appeared in [19], and is in a more general 
form in [13]. 

(1) Each domino in Q covers two boxes of A/core2(A). Move the entries in Q to the box that 
has content modulo 2. 



Q 





1 


1 


2 


1 


2 


3 


3 


4 








5 


6 











1 




2 




1 




2 




1 


i 3 




3 


i 4 






6 i 


6 





(2) Let S^^^ denote the set of all dominoes that have the entry in the lower or leftmost box, 
and S^^^ be the set of dominoes that have the entry in the upper or rightmost box. 



1 


1 


1 


















6 




5 





1 



and 



I 



1 



(3) For even -^(A) < i < Ai and j G {0, 1}, let 

(j) The increasing sequence of entries whose 



content is i and whose domino is in 



(i)i"i,i)i%<\Dr,z)r) = ((5),(i,6),(i),(i),()) 

{D%D%Di^\D^^\D^^^) = (0,(4), (3), (2, 3), (2)) 

(4) Let Q^^^ be the unique tableau that has increasing diagonal sequences given by the 
for all even — ^(A) < i < Ai. 



1 


1 


1| 


5 


6 





4 
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Remarks. 



1. If the shape of the domino tableau Q is A/core2(A), then the shape of {Q^^\Q^^^) is 
quota (A). 

2. We may apply this algorithm to a domino tableau of shape A/(m) with m = |core2(A)| 
mod 2, by requiring that the tableau of shape A/core2(A) has [m/2j horizontal dominoes 
filled with zeroes. For example, 



Q 







1 






1 


i 2 




1 




3 




3 




4 






5 




6 





has shape A/(5), so apply the algorithm to 













1 


i 2 




1 




3 




3 




4 








6 




6 







Note that all of the zero dominoes are in the same set so changing m corre- 

sponds to adding or subtracting the number of zeroes in the first row of Q(I'^°''^2(A)|) 



We will use the lexicographic total ordering on partitions given by 

A < /X if there exists k € Z>i such that Afc < and Aj = for 1 < i < k. 



(5.2) 



Lemma 5.1. Let X E Vn be such that core2(A) G {(0), (1)}, a,nd let < m < Xi be such that 
m = |core2(A)| mod 2. Then there exists a lexicographically maximal weight n = (//i, //2, • • • , A*^) 
such that there exists exactly one domino tableau of shape A/(m) and weight (m, ^ui, . . . 

Proof. First suppose (A(°V7^°^ ^^^Vt^^^) 

is a pair of skew partitions. Let fxi be the maximal 
number of I's we can put in a tableau of shape (X^'^^ /'y^^\ X^^^ /j^^^), 112 be the maximal number 
of 2's wc can thereafter fill into (A'''^^/7'''^\ A(^-'/7(^-'), and be the maximal number of j's 
we can fill given that wc have filled in a maximum number at each step up to j. Then there 
is exactly one tableau {Q^^\Q^^^) of shape (A(°V7^°^ A^^Vt^^^) and weight ji, and this weight 
is lexicographically maximal. The result now follows from pulling back through 
the bijection (5.1) to get a domino tableau of the same weight, along with the second remark 
preceding this Lemma. □ 



Remark. If m = core2(A), then /i is given by ^iq = |core2(A)| and Hi = quot2(A)j for i> 1. 



5.2 Multiplicity results 

Our first consequence of Theorem 4.3 characterizes which irreducible characters of U(n,Fq2) 
appear with nonzero multiplicity in some degenerate Gclfand-Graev character. 

Corollary 5.1. The set of all X G such that the character x'^ o/U(n,Fq2) satisfies {x'^j^{k,i')) 7^ 
for some degenerate Gelfand-Graev character ^(k,v) 

{A G :P® I core2(A^'^)) G {(0), (1)} whenever \(p\ is odd}. 

Proof. By Theorem 4.3, the irreducible character appears with nonzero multiplicity in some 
degenerate Gelfand-Graev character if and only if there a battery tableau of shape A/7 for some 
7 G with ht(7) < 1. 

If for some odd (p £ Q, we have core2(A*-'^^) ^ {(0), (1)}, then the 2-core of A^*^-* has at least 
two parts. But then there is no choice of 7^'^^ that allows us to tile A^'*'^/7^'^^ by dominoes. On 
the other hand, if core2(A*^'^-') = (0), we can choose 7^''') = (0), and if core2(A^'^^) = (1), we can 
let 7^^^) = (1), and A^^Vt^^-" can be tiled by dominoes. □ 
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A character % of U(n, ¥^2 ) is called regular if it is a component of the Gelfand-Graev character 
r(„). The next result follows directly from Corollary 5.1 and [11, Corollary 2.6]. For the definition 
of Harish-Chandra series, see [1]. 

Corollary 5.2. The set all A € V® such that the character o/U(n,Fq2) is in the union of 
all Harish-Chandra series that contain regular characters is 

{A G :P® I core2(A('^)) G {(0), (1)} whenever \(p\ is odd}. 

We now specify multiplicities of certain characters x"^ in degenerate Gelfand-Graev charac- 
ters. 

Theorem 5.1. Let A G be such that coTe2{X^'^^) G {(0),(1)} whenever \ip\ is odd. Then 
there exists v h such that 

i odd 

\^p\ even 

Proof. Let k = odd |<^||core2(A('^))| and define 7 by 

if) — / core2(A*^'^^) if is odd, 
\ otherwise. 

Since I7I = k, by Theorem 4.3 and Corollary 5.1, it suffices to find v h such that there exist 

n n (\^'^ - + 1) 

vee i odd 

\ip\ even 

battery tableaux with shape A/7 and weight {k, u). 

We construct the battery tableau Q as follows. For odd let Q*^'^-' be the unique domino 

tableau of shape A(^V(core2(A('^^)) and weight (|core2(A('^))|, quot2(A('^))i, quot2(A('^^)2, . . .), 
obtained from Lemma 5.1 (see, in particular, the remark after the lemma). 

For even <y9 G and for each i > 1, we fill the (2i — l)st row of A^"^-* with i's, and the 2ith row 
with z's. The resulting symplectic tableau Q^"^) has weight (A^^^ + A^'^\ A^"^^ + xf\ ...). Note 

that we may change up to \^2i-i ~ ^^2i ^'^ ^'^ ™ 2i — 1 while leaving the weight 

unchanged. We therefore have exactly 

n - a;!1 + 1) 

i odd 

symplectic tableaux of shape A*^'^-' and weight (A^'^'' + A2'^'' , Ag'^'' + X^^\ . . .). 

We combine these to create a battery tableau of shape A/7 and weight where 

u,= Y. l<^|quot2(A(^)).+ E ^(A^f + a(£,)- 

|c^| odd \ip\ even 

Note that from this construction, v is the maximal weight under the lexicographical ordering 
(5.2) of a battery tableau of shape A/7, while each 'y'^'^^ is chosen minimally. It follows that the 
weight V will change if we change the weight of any Q'^'^'^. 



24 



For example, if 



(^i) 



where \ipi 



then A; = 1, 1/ = (2 + 4 + 3, + 1 + 3) = (9, 4), and every battery tableau of shape A and weight 
{k, v) must be of the form 



where i G {i, i}. 



There are 3 • 2 = 6 of such tableaux. 



□ 



Theorem 5.1 and its proof give the following multiplicity one result. 

Corollary 5.3. Let A G ■ Suppose core2(A^'^^) € {(0),(1)} whenever \ip\ is odd, and for all 
i > 0, the multiplicities mi{X^^'') are even for all even if €Q. Then {r(k,u)7X'^) = 1; where 



k= J2 l<^l|core2(A(^))| and n=Y. M^^ot^{>-^^\ + E ¥(^2?^ +^2^1) 



fee 

\ip\ odd 



\ip\ odd 



\ip\ even 



The next theorem generalizes Corollary 5.3. 
Theorem 5.2. Suppose A G satisfies the following: 

(a) Whenever \(p\ is odd, core2(A(^)) G {(0), (1)}, 

(b) Whenever \(p\ is even, the partition A*-*^^ has at most one nonzero part with odd multiplicity, 

(c) There exists an r > such that for every (p £ Q with \ip\ even, either < r and X^'^^ 
has no nonzero part of odd multiplicity, or Xr^^ has odd multiplicity and xi^^ < x'^'f^^^ . 

Then the irreducible character ofUn appears with multiplicity one in some degenerate Gelfand- 
Graev character of Un ■ 

Proof. Suppose A G satisfies (a), (b), and (c). Let 7 G "P® be given by 



7 



) if Iv'l is even and mj(A*''^-') is odd, 

core2(A)| + 2quot2(A)[l?°2f ^^^'^) if W\ is odd and A = A^^). 



For example, the 0-partition 
A = 



(^1) 



(¥'2) 



with \ipi 



satisfies (a), (b), and (c) with r = 5. Since 



quot2(A(^i 



](0) 



(1)' 



and 



core2 



(A(^i)) = (1) 



(as in the example for (5.1)), we have that 



|core2(A('^^))| + 2quot2(A('^i))[;.}2^ =3 and 7 = (^^^^^ri^^^) • 
Consider the following battery tableau Q of shape A/7. 
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1. For G e such that |(^| is even, fill A^'^Vt^^^ with Agi^ fs and Ag^ j's for 2j < i{X^'^^) 

f 1 < ^(A^'^)) sucl 
and the resulting weight is lexicographically 



such that 2j < r, and A^^ fs and A^^^ fs for 2j + 1 < e{X^'^^) such that 2j > r. Then 



all of the nonzero entries come in pairs 
maximal. 

2. For if G Q such that \(p\ is odd, use Lemma 5.1 to fih A^'^Vt^'^^ 

in a lexicographically 

maximal way. 



In our running example, we have 



Q 












1 


1 


1 


1 


1 


2 


2 


2 


2 








1 


1 


1 


1 


2 


2 


2 


2 





(V'2) 



n(¥'4) 



' 1 



Note that by Lemma 5.1, Q is the only battery tableau of shape A/7 and weight wt(Q). 
Thus, it suffices to show that there is no 1/ C A with = I7I and ht(i/) < 1 such that there 
exists a battery tableau P of shape X/v and weight wt(Q). 

Since ji^j = I7I, we may think of moving from Q to P by shifting zero entries between ip £ Q 
in Q. If \ip\ is even, it is clear from the construction of Q*^*^) that if we add a zero, an entry 
< r/2 is lost, while if we remove a zero, an entry > r/2 is gained. Now consider when \ip\ is 
odd, with Q = Q^*^) and A = X^'^\ Apply the bijection (5.1) to the domino tableau Q, and 
notice that from Remark 2 preceding Lemma 5.1, our choice of 7^^) forces Q(|corc2(A)|) ^^^^^ 
exactly quot2(A)|^°2^^^'^^^ O's. Now, adding a pair of zero entries to or removing a pair of zero 

entries from Q is the same as adding a zero to or removing a zero from q(\^°^^^W\) . It is clear 
that adding a zero to Q(\^°^^^W\) results in losing an entry < r/2, which removes a domino with 
entry < r/2 in Q, and removing a zero from q(\^°^^^(^)\) results in gaining an entry > r/2, which 
adds a domino with entry > r/2 in Q. Thus, no matter how we change 7 to v, we are forced to 
change the weight of the full battery tableau to a lexicographically smaller weight. So, there is 
no such u which leaves the weight unchanged, and uniqueness follows. □ 

Remarks. Corollary 5.3 follows from Theorem 5.2, since (a) and (b) are easily satisfied, and 

r = max{£(A('^^) | G 6, |(^| even} + 1. 

Another consequence of Theorem 5.2 is a result by Ohmori [17]. 

Corollary 5.4 (Ohmori). Let X € , and define the partition ji to have parts 

/X, = ^ \^\xf. 

fee 

Suppose that fi = (l"^i2™2 . . .) is such that rrii is even for all i except for the one value i = k, 
or that rrii is always even, in which case we let k = 0. Define the partition v to be v = 
^-|^mi/22m2/2 . . . ^(mfc-i)/2 . . . Then the irreducible character appears with multiplicity one 
in the degenerate Gelfand-Graev character T (^f. 

Proof. Note that if A G "P® satisfies the hypotheses of the corollary, then for any ip G Q the 
partition A^"^-* has at most one nonzero part size with odd multiplicity, otherwise /x would have 
more parts with odd multiplicity. Thus, A satisfies condition (b) of Theorem 5.2. Moreover, the 
fact that /X has at most one part with odd multiplicity implies that there must be an r > such 
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that for every ip G e, either ^(A^'^)) < r or A^.*^^ has odd multipHcity in A^*^) and A^*^^ < A^. 

In particular, this holds when \ip\ is even, and so A satisfies condition (c) of Theorem 5.2. If 
G G is odd, and A^'''-' has a part size i with odd multiplicity, where i = if £(A'^'^'*) < r, then 



core2 



(A('^)) 



(1) if i is odd, 
(0) if i is even. 



Thus, A satisfies (a) of Theorem 5.2. 

Now define 7 by 7^'^) = i if mi{X^'^^) is odd, where i = if ^(A^'^)) < r. Then I7I = A;. When 
|(^| is even, fill A^'^Vt^'^^ just as in the proof of Theorem 5.2. When \^\ is odd, fill A^'^Vt^'^^ 
with all vertical dominoes such that there are X^2j-i f^"^ 2_7 — 1 < ^(A^*^^) such that 2j — 1 < r, 

and \\^^ j's for 2j < ^(A'''^-') such that 2j > r. This gives a battery tableau of shape A/7, where 
I7I = /c, and weight as defined above. 

Fix a if such that is odd, let A = A^*^-*, and let Q^'''^ = Q be the domino tableau just 
defined, and apply the bijection (5.1) to Q. Since Q has been filled with all vertical dominoes, 
the resulting weight is lexicographically maximal, and so by Lemma 5.1, the tableaux Q^^^ 
and Q^^^ obtained from the bijection (5.1) also have lexicographically maximal weights. Let 
j = |core2(A)|, and consider Q^^\ From our choice of 7^*^-*, the tableau Q^^^ has exactly [Ar/2j 
O's. By the bijection (5.1), we also have row [r/2] of Q(^), which is quota (A^^) ) ' 

is exactly 

LA,./2j. This means the domino tableau Q^"^) is exactly what is constructed in the proof of 
Theorem 5.2. Therefore, Q is exactly the battery tableau obtained in the proof of Theorem 5.2, 
and so we have {x'^:^{k,iy)) = 1- ^ 

Note that by Corollary 5.1, condition (a) of Theorem 5.2 is a necessary condition. The 
following proposition shows that condition (b) is also necessary. 

Proposition 5.1. Let A € "P®. // there exists a ip £ Q such that \ip\ is even and X^'^^ has at 
least two distinct part sizes with odd multiplicity, then 

(x^^(ik,.))7^l 

for all degenerate Gelfand-Graev characters ^(k,i/)- 

Proof. Suppose A G and \(p\ is even, such that A = A^'''^ has part sizes x < y with odd 
multiplicity. Let Q be a symplectic tableau of shape A/(m) for some m < \i, and suppose 
wt{Q) = fi. If there exists an i such that there is no i directly south of i in Q, then there is a 
second symplectic tableau P of shape A / (m) and weight /x obtained by changing this z to an z 
in Q. Similarly, if there is an i with no i directly north of it, then there is a second tableau P 
with the same weight and shape as Q. Thus, the only way Q is the only tableau of shape A/ (m) 
and weight /x, is if A/(m) can be tiled by vertical dominoes. 

If m < y, then the yth column of A/ (m) has an odd number of boxes, and therefore cannot 
be tiled by vertical dominoes. If m > y, then the mth column of A/(to) has an odd number of 
boxes. If m = y, then the xth column of A/(m) has an odd number of boxes. In all cases, A/(m) 
cannot be tiled by dominoes, and the result follows. □ 

Remarks. 

1. While conditions (a) and (b) of Theorem 5.2 are necessary, condition (c) is not. For 
example, the only battery tableau of weight (2, (8)) for the 6-partition 

A = d'^)) with |«| = 4, 1^1 = 2, is Q = d^)) . 
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2. At the same time, conditions (a) and (b) of Theorem 5.2 are not alone sufficient. For 
example, 

A = (g^"\ n^"^ ) , with H = 1/31 = 2, 
satisfies (a) and (b). The possible weights and two of their battery tableaux are 



(0, (6)) 
(0,(4,2)) 
(0,(2^)) 

(2, (4)) 
(2, (2^)) 

(4,(2)) 



T] ' 



T] 
T] 

1] 



[TfP 



(2 total), 
(10 total), 
(24 total), 
(5 total), 
(12 total), 
(2 total). 



References 



[1] R. Carter, Finite groups of Lie type: conjugacy classes and complex characters. John Wiley 
and Sons, 1985. 

[2] Y. M. Chen, A. M. Garsia, and J. Remmel, Algorithms for plethysm. In: Combinatorics and 
algebra. Boulder, Colo., 1983, In: Contemp. Math., vol. 13, Amer. Math. Soc, Providence, 
RI, 1984, pp. 109-153. 

[3] P. Deligne and G. Lusztig, Representations of reductive groups over finite fields, Ann. of 
Math. (2) 103 (1976), no. 1, 103-161. 

[4] F. Digne and J. Michel, Foncteurs de Lusztig et caracteres des groupes lineaires et unitaires 
sur un corps fini, J. Algebra 107 (1987), no. 1, 217-255. 

[5] V. Ennola, On the conjugacy classes of the finite unitary groups, Ann. Acad. Sci. Fenn. 
Ser. A I No. 313 (1962), 13 pages. 

[6] V. Ennola, On the characters of the finite unitary groups, Ann. Acad. Sci. Fenn. Ser. A I 
No. 323 (1963), 35 pages. 

[7] I. M. Gelfand and M. I. Graev, Construction of irreducible representations of simple alge- 
braic groups over a finite field, Dokl. Akad. Nauk SSSR 147 (1962), 529-532. 

[8] R. Hotta and T. A. Springer, A specialization theorem for certain Weyl group represen- 
tations and an application to the Green polynomials of unitary groups. Invent. Math. 41 
(1977), no. 2, 113-127. 

[9] R. B. Howlett and C. Zworestine, On Klyachko's model for the representations of finite 
general linear groups. In Representations and quantizations (Shanghai, 1998), pages 229- 
245, China High. Educ. Press, Beijing, 2000. 



28 



[10] N. Kawanaka, Generalized Gel'fand-Graev representations and Ennola duality, In Algebraic 
groups and related topics (Kyoto/Nagoya, 1983), 175-206, Adv. Stud. Pure Math., 6, North- 
Holland, Amsterdam, 1985. 

[11] D. Kotlar, On the irreducible components of degenerate Gelfand-Graev characters, J. Al- 
gebra 173 (1995), no. 2, 248-260. 

[12] T. Lam, Ribbon tableaux and the Heisenberg algebra. Math. Z. 250 (2005), 685-710. 

[13] A. Lascoux, B. Leclerc, and J.-Y. Thibon, Ribbon tableaux, Hall-Littlewood functions, and 
unipotent varieties, Sem. Lothar. Combin. 34 (1995), 23 pages. 

[14] B. Leclerc and J.-Y. Thibon, Littlewood-Richardson coefficients and Kazhdan-Lusztig poly- 
nomials. Combinatorial methods in representation theory (Kyoto, 1998), 155-220, Adv. 
Stud. Pure Math., 28, Kinokuniya, Tokyo, 2000. 

[15] G. Lusztig and B. Srinivasan, The characters of the finite unitary groups, J. Algebra 49 
(1977), no. 1, 167-171. 

[16] I. G. Macdonald, Symmetric functions and Hall polynomials. Second edition. With Contri- 
butions by A. Zelevinsky. Oxford Mathematical Monographs. Oxford Science Publications. 
The Clarendon Press, Oxford University Press, New York, 1995. 

[17] Z. Ohmori, On a Zelevinsky theorem and the Schur indices of the finite unitary groups, J. 
Math. Sci. Univ. Tokyo 2 (1997), no. 2, 417-433. 

[18] J. G. Rainbolt, The generalized Gelfand-Graev representations of U(3,g), J. Algebra 202 
(1998), no. 1, 44-71. 

[19] D. W. Stanton and D. E. White, A Schensted algorithm for rim hook tableaux, J. Comb. 
Theory Ser. A 40 (1985), no. 2, 211-247. 

[20] R. Steinberg, Lectures on Chevalley groups, mimeographed notes, Yale University, 1968. 

[21] N. Thiem and C. R. Vinroot, On the characteristic map of finite unitary groups. Adv. 
Math., to appear. 

[22] T. Yokonuma, Sur le commutant d'une representation d'un groupe de Chevalley fini, J. 
Fac. Sci. Univ. Tokyo Sec. I 15 (1968), 115-129. 

[23] T. Yokonuma, Complement au mcmoirc "Sur le commutant d'une representation d'un 
groupe de Chevalley fini", J. Fac. Sci. Univ. Tokyo Sect. I 16 (1969), 147-148. 

[24] A. V. Zelevinsky, Representations of finite classical groups. A Hopf algebra approach. Lec- 
ture Notes in Mathematics 869, Springer- Verlag, Berlin-New York, 1981. 



29 



